Electronic Version 
Stylesheet Version vl.1.1 

Description 

[INTERACTIVE COMPUTER-ASSISTED 
LANGUAGE LEARNING METHOD AND 

SYSTEM THEREOF] 

Cross Reference to Related Applications 

[0001] This application claims the priority benefit of Taiwan ap- 
plication serial no. 93101483, filed January 20, 2004. 
Background of Invention 

[0002] Field of the Invention 

[0003] The present invention relates to a language learning sys- 
tem and method. More particularly, the present invention 
relates to interactive computer-assisted language learning 
method and system. 

[0004] Description of the Related Art 

[0005] Language is a major tool for communication between 

people. In this global village century, the capacity to com- 
municate in a multiple languages is a great personal as- 
set. 



[0006] At present, languages can be learnt through self-study 
aids including books, television, learning cassettes, com- 
pact discs, broadcast and the internet or interactive com- 
munication with a language teacher. In recent years, the 
popularization of computers renders computer-assisted 
language learning method possible. One big advantage of 
learning through the software inside a computer-assisted 
language learning system is that language learning is no 
longer restricted to a particular period of time or limited 
to a particular location. Furthermore, language learning 
software has advanced from a unidirectional output mode 
to a bidirectional output mode. Voice recognition tech- 
niques are frequently deployed to analyze the learner"s 
pronunciation and provide a reference feedback to the 
learner. Moreover, a voice synthesizer or a pre-recorded 
sound track can be used to provide a model pronunciation 
to the learners so that the learners may correct their own 
pronunciation according to the model. 

[0007] | n general, a language learner needs to master three ma- 
jor aspects of a language, namely, vocalizing, hearing and 
grammar. At present, most computer-assisted language 
learning software has attained basic bidirectional commu- 
nication in vocalization. However, hearing and grammar 



still remains in a unidirectional learning mode. Moreover, 
most pronunciation software packages are only able to 
analyze the pronunciation of each word pronounced by 
the learner and provide a comparison with the correct 
pronunciation by means of a marking scheme. Although 
the learners can improve their pronunciation to a level 
similar to the correct pronunciation after repeated train- 
ing, the method only provides the learner with segmental 
learning. In other words, what the learner can learn is the 
correct pronunciation of single words so that the learner 
may not distinguish between words having a similar pro- 
nunciation. 

[0008] Furthermore, a conventional language learning system has 
no facility for gathering information about the shortcom- 
ings of a learner and providing related information for im- 
provement in return. Consequently, an erroneous pronun- 
ciation of words may be unknowingly reproduced in an- 
other exercise after the learner has pronounced a similar 
word in a previous exercise. Ultimately, the learning effi- 
ciency is hard to improve. 

[0009] | n addition, the conventional language learning system 

stores its learning program inside an accessible computer 
terminal or inside a remote computer terminal and ac- 



cessed through the internet. In general, the learner has to 
look up the required program from a content list. There- 
fore, it is inconvenient for the learner to get the language 
training for a particular type of situation such as ordering 
from a menu or booking a hotel room in advance. This is 
a great inconvenience to the learner who has access to the 

language learning system. 
Summary of Invention 

[0010] Accordingly, at least one objective of the present inven- 
tion is to provide an interactive computer-assisted lan- 
guage learning method that can increase the interactivity 
with learners and strengthen the learners" weak points by 
providing exercises targeting errors they frequently made. 

[0011] At least a second objective of the present invention is to 
provide a language learning system that can supply a par- 
ticular learning program on request and provide exercises 
that integrate hearing, grammar and vocalization together 
so that the learner is able to get complete bidirectional 
language training. 

[0012] jo achieve these and other advantages and in accordance 
with the purpose of the invention, as embodied and 
broadly described herein, the invention provides an inter- 
active computer-assisted language learning method that 



can be implemented through a language learning system. 
First, a first sentence is pronounced according to a first 
acoustic signal stored inside the language learning sys- 
tem. The learner pronounces the first sentence to produce 
a first pronunciation signal by imitating the pronunciation 
provided by the language learning system. Thereafter, the 
language learning system compares the first acoustic sig- 
nal with the first pronunciation signal to produce a first 
compared result. The learner modifies the first pronuncia- 
tion according to the first compared result and produces a 
second pronunciation so that a second acoustic signal is 
registered by the language learning system. The language 
learning system compares the first acoustic signal with 
the second acoustic signal to produce a second compared 
result. Through the registered first and second compared 
result, the language learning system performs an analysis 
and outputs a comment to the learner for reference. 
[0013] According to one embodiment of the present invention, 
the learner may first select the learning program. There- 
after, the language learning system picks up the first sen- 
tence from the requested learning program. The learner 
can select the required learning program by inputting a 
voice command or a textual command. 



[0014] According to one embodiment of the present invention, 
the language learning system may output a multiple of 
pronunciations of the second sentence. Furthermore, each 
pronunciation of the second sentence belongs to a group 
of pronunciations that easily confuse with the pronuncia- 
tion of the first sentence so that the learner is trained to 
distinguish between the pronunciation of the first sen- 
tence and the second sentence. In addition, the language 
learning system may output full sentences, phrases and 
synonyms that are closely related to the first sentence so 
that the learner is able to learn grammar and hearing as 
well. 

[0015] According to one embodiment of the present invention, 

the comment is either announced vocally or displayed as a 
textual message. 

[0016] According to one embodiment of the present invention, 
the language learning system has the capacity to design a 
special program for training the pronunciation of the 
learner according to the compared result so that the weak 
points of the learner can be strengthened. 

[0017] The present invention also provides a language learning 
system. The language learning system mainly comprises a 
voice recognition engine, a database, an analysis/pro- 



cessing unit and a voice-synthesizing unit. The voice 
recognition engine recognizes a multiple of pronuncia- 
tions of a first sentence produced by the learner and out- 
puts a first pronunciation signal corresponding from the 
database to each first sentence. The database stores a 
plurality of acoustic signals that includes a multiple of 
first acoustic signals. Furthermore, each first acoustic sig- 
nal corresponds to the pronunciation of one of the first 
sentences. 

[0018] The analysis/processing unit is connected to the voice 
recognition engine and the database for comparing the 
first pronunciation signal from the voice recognition en- 
gine with the fist acoustic signal from the database to 
produce and register a compared result. According to the 
compared result, the analysis/processing unit outputs a 
comment to the learner for reference. Thereafter, the 
compared result is used to design a special program for 
training the pronunciation of the learner. The voice- 
synthesizing unit is connected to the analysis/processing 
unit for converting the textual data from the database into 
vocal sound. 

[0019] According to one embodiment of the present invention, 

the language learning system further comprises a learning 



interface. The learning interface is connected to the voice 
recognition engine and the voice-synthesizing unit for re- 
ceiving a command from the learner and transferring the 
command to the analysis/processing unit. The analysis/ 
processing unit selects a learning program from the 
database according to the command and displays the 
learning program on the learning interface. The first sen- 
tence is selected from the chosen learning program. The 
command feeds in by the learner can be a voice command 
or a textual command. After performing an analysis on 
the voice command, the voice recognition engine converts 
the voice command into a textual command. 

[0020] According to one embodiment of the present invention, 

the database holds full sentences, phrases, synonyms or a 
combination of them that are closely related to each first 
sentence. In another embodiment of the present inven- 
tion, the database preferably holds a plurality of second 
acoustic signals as well. Each second acoustic signal cor- 
responds to the pronunciation of a second sentence. Fur- 
thermore, the pronunciation of each second sentence is 
very similar to the pronunciation of each first sentence. 

[° 021 ] Since the present invention has the capacity to record the 
learning history, perform analysis of the learning process 



and provide timely statements on the blind spot of a lan- 
guage learner, the learner is prevented from repeating the 
same mistake again. In other words, the learning effi- 
ciency of the learner can be improved. Furthermore, the 
invention also provides a learner learning the pronuncia- 
tion of a single word with other easily confused words so 
that the learner is trained to distinguish their differences. 
In addition, the present invention also provides full sen- 
tences, phrases and synonyms that are closely related to 
the single words so that learners may simultaneously im- 
prove their grammatical understanding and hearing while 
pronouncing the words. Hence, the present invention is 
able to provide the learner with continuous learning in- 
stead of piecewise learning. 

[0022] | n addition, the present invention permits the learners to 
select their required learning programs. The learner may 
select the learning program through a voice command or 
by textual input so that the language learning system can 
be used in a flexible way. 

[0023] it is to be understood that both the foregoing general de- 
scription and the following detailed description are exem- 
plary, and are intended to provide further explanation of 
the invention as claimed. 



Brief Description of Drawings 

[0024] The accompanying drawings are included to provide a 

further understanding of the invention, and are incorpo- 
rated in and constitute a part of this specification. The 
drawings illustrate embodiments of the invention and, to- 
gether with the description, serve to explain the principles 
of the invention. 

[0025] pig. 1 is a block diagram showing a language learning 
system according to one preferred embodiment of the 
present invention. 

[0026] pig. 2 is a flowchart showing the steps carried out in an 

interactive computer-assisted language learning process 

according to the present invention. 
Detailed Description 

[0027] Reference will now be made in detail to the present pre- 
ferred embodiments of the invention, examples of which 
are illustrated in the accompanying drawings. Wherever 
possible, the same reference numbers are used in the 
drawings and the description to refer to the same or like 
parts. 

[0028] Fig. 1 is a block diagram showing a language learning 
system according to one preferred embodiment of the 



present invention. As shown in Fig. 1, the language learn- 
ing system 100 mainly comprises a voice recognition en- 
gine 102, a database 106, an analysis/processing unit 
104 and a voice-synthesizing unit 108. The voice recog- 
nition engine 102 is connected to the analysis/processing 
unit 104 for receiving a learner's pronunciation of a first 
sentence and outputting a corresponding first pronuncia- 
tion signal after performing an recognition of the learner's 
pronunciation. The first sentence can be a single word, a 
phrase or a full sentence, for example. The database 106 
is a storage area for holding learning programs and a plu- 
rality of acoustic signals. The acoustic signals further 
comprise all the first acoustic signals that correspond to 
the pronunciation of the first sentence. 
[0029] The analysis/processing unit 108 is connected to the 

voice recognition engine 102 and the database 106. When 
the learner practices the pronunciation of the first sen- 
tence, the voice recognition engine 102 will receive and 
recognize the pronunciation produced by the learner. 
Thereafter, the recognized first voice signal is output to 
the analysis/processing unit 104. The analysis/processing 
unit 104 reads out the first acoustic signal from the 
database 106 and compares with the first voice signal so 



that a compared result is output to the learner for refer- 
ence. In the meantime, the analysis/processing unit 104 
will also record the learning history of the learner. After 
performing an analysis and summary on the learning his- 
tory of the learner, a learning program for training the 
learner in proper pronunciation with special attention to 
the most common mistakes is designed. Thus, the leaner 
can have more practice to strengthen their weak points. 
[0030] Furthermore, after performing an analysis on the first 

sentence, the analysis/processing unit 104 may read out a 
second acoustic signal from the database 106 that has a 
pronunciation so similar to the first sentence that it can 
be easily confused with the first sentence. Thereafter, the 
second acoustic signal is output via the voice-syn- 
thesizing unit 108 so that the learner is reminded about 
some confusing single words and learns to distinguish 
between them. For example, when a learner is practicing 
the pronunciation of the word "bat", the analysis/pro- 
cessing unit 104 may read out words that have a similar 
pronunciation such as "bet" and "bait" so that the learner 
can learn about these new words and avoid messing up 
the words later on. The analysis/processing unit 104 
gathers all second sentences whose correct pronunciation 



is similar to the first sentence together and defines them 
as a group of easily confused words. 

[0031] when a learner uses the language learning system 100 of 
the present invention to practice the pronunciation of sin- 
gle words, the analysis/processing unit 104 will also read 
out phrases, full sentences or synonyms closely related to 
the respective single words from the database 106. 
Through the voice-synthesizing unit 108, these phrases, 
full sentences or synonyms are pronounced so that the 
learner is able to learn some related grammatical knowl- 
edge other than word pronunciation and hence increase 
learning continuity. 

[0032] The voice-synthesizing unit 108 is connected to the anal- 
ysis/processing unit 104 for converting textual output 
from the language learning system 100 into voiced sound 
so that the learner is able to hear and follow. 

[0033] The language learning system 100 according to the 

present invention may further comprise a learning inter- 
face 110 so that a learner may select a desired learning 
program. As shown in Fig. 1, the learning interface 100 is 
connected to the voice recognition engine 102 and the 
voice-synthesizing unit 108 for receiving learner's input 
command and re-directing the command to the analysis/ 



processing unit 104. According to the command, the 
analysis/processing unit 104 retrieves acoustic signal 
from the database 106 and then transmits the acoustic 
signal to the learning interface 110 to produce the re- 
quired training program. 

[0034] Aside from using a keyboard to input textual command, 
the learner may also choose to use voice commands to 
select the required training program. When the learner 
uses a voice command to select the learning course, the 
voice recognition engine 102 can be used to recognize the 
voice command from the learning interface 110 and con- 
vert the voice command into textual command before 
transmitting to the analysis/processing unit 104. 

[0035] since the language learning system of the present inven- 
tion permits a bidirectional interaction with the learner, 
language learning efficiency is improved. 

[0036] pig. 2 is a flowchart showing the steps carried out in an 
interactive computer-assisted language learning process 
according to the present invention. The learning process 
can be executed using the language learning system 100 
(as shown in Fig. 1). In step S200, the learner selects the 
desired learning program. The learner may rely on a voice 
command to select or search for a particular learning pro- 



gram. Alternatively, the learner may use a keyboard to in- 
put textual commands to select or search for the learning 
program. 

[0037] | n step S202, the language learning system outputs the 
pronunciation of a first sentence. The first sentence can 
be a single word, a phrase or a full sentence, for example. 
In this embodiment, a single word is pronounced. In step 
S204, the learner imitates the pronunciation of the lan- 
guage learning system to produce a first pronunciation 
thereby generating a first pronunciation signal inside the 
language learning system. In step S206, the language 
learning system compares the first acoustic signal with 
the first pronunciation signal to produce a first compared 
result. 

[0038] | n s tep S208, the learner may modify the first pronuncia- 
tion according to the first compared result presented in 
step S206 and produce a second pronunciation. The sec- 
ond pronunciation generates a second pronunciation sig- 
nal inside the language learning system. Thereafter, in 
step S210, the language learning system compares the 
first acoustic signal with the second pronunciation signal 
to produce a second compared result. 

[0039] in step S212, the language learning system analyzes and 



summarizes the first and the second compared result 
recorded in steps S206 and S210 to discover the learner"s 
blind spot in learning and output a comment to the 
learner for reference. The comment is displayed in textual 
format or reported in voice format, for example. 

[0040] | n s tep 214, the present invention further provides the 
learner with a second sentence that has a pronunciation 
very similar to the first sentence. Hence, the learner can 
avoid confusing single words with a similar pronunciation. 
In addition, the present invention also provides phrases, 
full sentences and synonyms related to the first sentence 
so that the learner can learn some grammar and clauses 
aside from the pronunciation. Ultimately, the learning 
program can provide the learner with a greater continuity. 

[0041] since the present invention is capable of recording the 
learning history of a learner, perform analysis of the 
learning process and provide timely statements on the 
blind spot of the learner, the learner is prevented from re- 
peating the same mistake again. In other words, the 
learning efficiency of the learner can be improved. 

[0042] Furthermore, the invention also provides a learner learn- 
ing the pronunciation of single words with other easily 
confused words so that the learner is trained to distin- 



guish their differences. In addition, the present invention 
also provides full sentences, phrases and synonyms that 
are closely related to the single words so that learners 
may simultaneously improve their grammatical under- 
standing and hearing while practicing pronunciation. Con- 
sequently, the present invention is able to provide the 
learner with continuous learning instead of piecewise 
learning. 

[0043] | n addition, the present invention permits the learners to 
select their own learning programs. The learner may se- 
lect the learning program through a voice command or a 
textual command so that the language learning system 
can be used in a flexible way. 

[0044] | n conclusion, the present invention provides an interac- 
tive computer-assisted language learning method with a 
higher degree of interaction between the language learn- 
ing system and the learner to improve learning efficiency. 

[0045] it w i|| be apparent to those skilled in the art that various 
modifications and variations can be made to the structure 
of the present invention without departing from the scope 
or spirit of the invention. In view of the foregoing, it is in- 
tended that the present invention cover modifications and 
variations of this invention provided they fall within the 



scope of the following claims and their equivalents. 



